United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
I nilid Stall-, l'atint and Trademark Office 

Address: COMMISSIONER FOR PATENTS 



APPLICATION NO. 



10/715.093 



FILING DATE 



I 1/17/2003 



FIRST NAMED INVENTOR 



Vesa Metsatahti 



ATTORNEY DOCKET NO. CONFIRMATION NO. 



042933/269? 16 



826 7590 03/20/2008 

ALSTON & BIRD LLP 

BANK OF AMERICA PLAZA 

101 SOUTH TRYON STREET, SUITE 4000 

CHARLOTTE, NC 28280-4000 



HWANG, JOON H 



PAPER NUMBER 



DELIVERY MODE 



Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 



PTOL-90A (Rev. 04/07) 



l/ffflrC? nVrliUli Otfff Iff ids y 


Application No. 

10/715,093 


Applicant(s) 

METSATAHTI ETAL. 


Examiner 

JOON H. HWANG 


Art Unit 

2166 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address — 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )KI Responsive to communication(s) filed on 12 December 2007 . 
2a )^ This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^3 Claim(s) 1,2,6-12, 16-23,26-41,43-50,52-59 and 61 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) |EI Claim(s) 1.2.6-12. 16-23.26-41.43-50.52-59 and 61 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) Q The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

20 Certified copies of the priority documents have been received in Application No. . 

3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1 ) □ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) |EI Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-152) 

Paper No(s)/Mail Date 3/3/08 . 6) □ Other: . 



PTOL-326 (Rev. 7-05) 



Office Action Summary 



Part of Paper No./Mail Date 20080312 



Application/Control Number: 10/715,093 Page 2 

Art Unit: 2166 

DETAILED ACTION 

1 . The applicants amended claims 1 , 1 1 , 21 , 30, and 32, canceled claims 42, 51 , 
and 60, and added new claim 61 in the amendment filed on 12/12/07. 

The claims 1-2, 6-12, 16-23, and 26-41, 43-50, 52-59, and 61 are pending. 

Response to Arguments 

2. Applicant's arguments filed on 12/12/07 have been fully considered but they are 
not persuasive. 

A. The applicants argue that Lauris does not teach "instructions for adding 
frames to items of information based on metadata associated with the item of 
information." 

The examiner respectfully traverses. 

According to the wikipedia.org web site, which the web site the applicants 
provided for the basis of the argument, "In the context of an information system, where 
the data is the content of the computer files, metadata about an individual data item 
would typically include the name of the field and its length. Metadata about a collection 
of data items, a computer file, might typically include the name of the file, the type of file 
and the name of the data administrator". 

The nodes/clusters in Lauris correspond to the file in the wikipedia web site. The 
operational status in Lauris corresponds to the name of the file or the type of the file in 
the wikipedia web site. Thus, the data regarding operational status of the 
nodes/clusters discussed in Lauris are metadata. 
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Therefore, Lauris teaches displaying a frame around the at least one item of 
information based on metadata associated with the item of information (i.e., a colored 
border around an object for a visual indicator, sections 8, 12, and 23). 

The applicants' argument is not persuasive. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-2 and 6-10 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Rothmuller et al. (U.S. Publication No. 2003/0033296) in view of Lauris (U.S. 
Publication No. 2003/0095143). 

With respect to claim 1 , Rothmuller teaches first instructions for generating a 
media view that provides access to digital media files and associates digital media files 
with a period of time (i.e., image area 100 in fig. 1 and digital media files with 
timestamps, sections 18 and 27). Rothmuller teaches second instructions for 
generating an information identifier that is associated with at least one item of 
information including at least one of a digital media file, a calendared event and a period 
of time, wherein the information identifier enhances identification of items of information 
(i.e., generating metadata tag icons associated with the media files, sections 4-6 and 
18-19). Rothmuller does not explicitly disclose displaying a frame around the at least 



Application/Control Number: 10/715,093 Page 4 

Art Unit: 2166 

one item of information. However, Lauris teaches displaying a frame around the at least 
one item of information based on metadata associated with the item of information (i.e., 
a colored border around an object for a visual indicator, sections 8, 12, and 23) in order 
to provide a look and feel of a graphical status display (sections 8 and 12). Therefore, 
based on Rothmuller in view of Lauris, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to utilize the teaching of 
Lauris to the system of Rothmuller in order to provide a look and feel of a graphical 
status display. 

With respect to claim 2, Rothmuller teaches instructions for including the 
information identifier in metadata associated with the respective item of information (i.e., 
metadata tag icons associated with the media files, sections 4-6 and 18-19). 

With respect to claim 6, Rothmuller teaches third instructions for generating a 
calendar view that represents time in calendar format and associates events with 
respective time periods (section 21 and fig. 4). 

With respect to claim 7, Rothmuller teaches an information identifier associated 
with a calendar event that is displayed in the calendar view (section 21 and fig. 4). 

With respect to claim 8, Rothmuller teaches third instructions for generating a 
time bar that divides time into segments having a size that depends upon the digital 
media files in the media view associated with the respective segment of time (i.e., a 
timeline divided time into segments having a bar graph size that is based on a total 
number of digital media files, section 31 and fig. 3). 
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With respect to claim 9, Rothmuller teaches an information identifier associated 
with a period of time that is displayed in the time bar (sections 8, 27, and 31, and fig. 3). 

With respect to claim 10, Rothmuller teaches an information identifier associated 
with a digital media file that is displayed in the media view (sections 4-6 and 18-19, and 

fig- 1) 

5. Claims 11-12,1 6-23, 26-29, 31 , 33, 43-47, 50, 52-56, 59, and 61 are rejected 
under 35 U.S.C. 103(a) as being unpatentable over Rothmuller et al. (U.S. Publication 
No. 2003/0033296) in view of Samra et al. (U.S. Publication No. 2002/01 13803), and 
further in view of Lauris (U.S. Publication No. 2003/0095143). 

With respect to claim 1 1 , Rothmuller teaches first instructions for generating a 
media view that provides access to digital media files and associates digital media files 
with a period of time (i.e., image area 100 in fig. 1 and digital media files with 
timestamps, sections 18 and 27). Rothmuller teaches second instructions for 
generating an information identifier that is associated with at least one item of 
information including at least one of a digital media file, a calendared event and a period 
of time, wherein the information identifier enhances identification of the at least one item 
of information (i.e., generating metadata tag icons associated with the media files, 
sections 4-6 and 1 8-1 9). Rothmuller teaches the second instructions for generating an 
information identifier further includes: instructions for providing for a text note to be 
associated with a respective item of information and to be included in metadata 
associated with the respective item of information (i.e., entering textual information as 
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metadata of an object, sections 5-6 and 18-19 and figs. 1-2); and instruction for 
graphically altering a representation of the respective item of information in a manner 
visually distinct from the associated text note (i.e., graphical representation of a media 
object combined with a graphical representation of a tag element, sections 5 and 39-40 
and fig. 6). Samra also further teaches instructions for providing for a text note to be 
associated with a respective item of information and to be included in metadata 
associated with the respective item of information (i.e., a dialogue box is appeared to 
allow the user to type a text message to be associated with a selected object, sections 
40 and 13-14); and instruction for graphically altering a representation of the respective 
item of information in a manner visually distinct from the associated text note (i.e., when 
a text message is completed, the annotated object is marked visually with an annotation 
marker, sections 40, 35, and 44 and figs. 1C-1D) in order to provide convenient, easily 
identified, information to a user without unduly cluttering the display (section 31). 
Therefore, based on Rothmuller in view of Samra, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to utilize the teaching 
of Samra to the system of Rothmuller in order to provide convenient, easily identified, 
information to a user without unduly cluttering the display. Rothmuller and Samra do 
not explicitly disclose the graphically altering including visually annotating items of 
information by adding frames around a representation of the item of information. 
However, Lauris teaches visually annotating items of information by adding frames 
around a representation of the item of information based on metadata associated with 
the item of information (i.e., a colored border around an object for a visual indicator, 
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sections 8, 12, and 23) in order to provide a look and feel of a graphical status display 
(sections 8 and 12). Therefore, based on Rothmuller in view of Samra, and further in 
view of Lauris, it would have been obvious to one having ordinary skill in the art at the 
time the invention was made to utilize the teaching of Lauris to the system of Rothmuller 
in order to provide a look and feel of a graphical status display. 

With respect to claim 12, Rothmuller teaches instructions for including the 
information identifier in metadata associated with the respective item of information (i.e., 
metadata tag icons associated with the media files, sections 4-6 and 18-19). 

With respect to claim 16, Rothmuller teaches third instructions for generating a 
calendar view that represents time in calendar format and associates events with 
respective time periods (section 21 and fig. 4). 

With respect to claim 17, Rothmuller teaches an information identifier associated 
with a calendar event that is displayed in the calendar view (section 21 and fig. 4). 

With respect to claim 18, Rothmuller teaches third instructions for generating a 
time bar that divides time into segments having a size that depends upon the digital 
media files in the media view associated with the respective segment of time (i.e., a 
timeline divided time into segments having a bar graph size that is based on a total 
number of digital media files, section 31 and fig. 3). 

With respect to claim 19, Rothmuller teaches an information identifier associated 
with a period of time that is displayed in the time bar (sections 8, 27, and 31, and fig. 3). 



Application/Control Number: 10/715,093 Page 8 

Art Unit: 2166 

With respect to claim 20, Rothmuller teaches an information identifier associated 
with a digital media file that is displayed in the media view (sections 4-6 and 18-19, and 

fig- 1) 

With respect to claim 21 , Rothmuller teaches selecting an information identifier 
option (i.e., tag keeper 300-350 in fig. 1). Rothmuller teaches selecting an item of 
information, including at least one of a media file, calendared event or time period to 
associate with the selected information identifier option (i.e., selecting a digital file in fig. 
1 ). Rothmuller teaches creating information identifier data for the selected item of 
information and storing the information identifier data with item of information metadata 
(i.e., dragging and dropping, sections 4-5 and 18-19). Rothmuller teaches creating a 
text message for the selected item of information (i.e., entering textual information as 
metadata of an object, sections 5-6 and 18-19 and figs. 1-2). Rothmuller teaches 
graphically altering a representation of the selected item of information in a manner 
visually distinct from the text message (i.e., a graphical representation of a media object 
combined with a graphical representation of a tag element, sections 5 and 39-40 and 
fig. 6). Samra also further teaches creating a text message for the selected item of 
information (i.e., a dialogue box is appeared to allow the user to type a text message to 
be associated with a selected object, sections 40 and 13-14); and graphically altering a 
representation of the selected item of information in a manner visually distinct from the 
text message (i.e., when a text message is completed, the annotated object is marked 
visually with an annotation marker, sections 40, 35, and 44 and figs. 1C-1D) in order to 
provide convenient, easily identified, information to a user without unduly cluttering the 
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display (section 31 ). Therefore, based on Rothmuller in view of Samra, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
to utilize the teaching of Samra to the system of Rothmuller in order to provide 
convenient, easily identified, information to a user without unduly cluttering the display. 
Rothmuller and Samra do not explicitly disclose the graphically altering including 
visually annotating items of information by adding frames around a representation of the 
item of information. However, Lauris teaches visually annotating items of information by 
adding frames around a representation of the item of information based on metadata 
associated with the item of information (i.e., a colored border around an object for a 
visual indicator, sections 8, 12, and 23) in order to provide a look and feel of a graphical 
status display (sections 8 and 12). Therefore, based on Rothmuller in view of Samra, 
and further in view of Lauris, it would have been obvious to one having ordinary skill in 
the art at the time the invention was made to utilize the teaching of Lauris to the system 
of Rothmuller in order to provide a look and feel of a graphical status display. 

With respect to claim 22, Rothmuller teaches identifying, visually, the item of 
information as associated with an information identifier (fig. 6). 

With respect to claim 23, Rothmuller teaches selecting an information identifier 
option from a group consisting of bookmark identifier and annotation identifier (i.e., 
textual metadata and optionally a graphical metadata, section 5). 

With respect to claim 26, Rothmuller teaches creating a graphical enhancement 
for the selected item of information (sections 39-40 and 5). 
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With respect to claim 27, Rothmuller teaches identifying the item of information 
with a bookmark identifier to indicate that the item of information has an associated text 
note (sections 4-6 and 18-19, fig. 2, fig. 4, and fig. 6). 

With respect to claim 28, Rothmuller teaches identifying the item of information 
with an annotation identifier that indicates a graphical enhancement for the visual 
representation of the item in a view of the media diary (sections 4-6, 18-19, and 39-40, 
fig. 2, fig. 4, and fig. 6). 

With respect to claim 29, Samra also teaches at least one of altering the size, 
color, or border of the representation of the selected item of information (i.e., a visual 
annotation in different colors, shapes, and animations, sections 35-37, 39-44, and 31 
and fig. 1) in order to provide convenient, easily identified, information to a user without 
unduly cluttering the display. Therefore, the limitations of claim 29 are rejected in the 
analysis of claim 21 above, and the claim is rejected on that basis. 

With respect to claim 31 , Samra also teaches at least one of altering the size, 
color, or border of the representation of the selected item of information (i.e., a visual 
annotation in different colors, shapes, and animations, sections 35-37, 39-44, and 31 
and fig. 1) in order to provide convenient, easily identified, information to a user without 
unduly cluttering the display. Therefore, the limitations of claim 31 are rejected in the 
analysis of claim 1 1 above, and the claim is rejected on that basis. 

With respect to claim 33, Rothmuller teaches displaying a window, after the 
information identifier is associated with the item of information, in order to allow a user 
to input the text note to be associated with the item of information (i.e., providing a 
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window to a user after a metadata tag icon is associated with a media object and 
allowing a user to edit metadata and/or photo notes, section 24 on page 2 and fig. 2). 

With respect to claim 43, Samra teaches a visual annotation marker of an object 
being associated with the text note (i.e., when a text message is completed, the 
annotated object is marked visually with an annotation marker, sections 40, 35-36, and 
44 and figs. 1C-1 D). Therefore, the limitations of claim 43 are rejected in the analysis of 
claim 1 1 above, and the claim is rejected on that basis. 

With respect to claim 44, Lauris further teaches instructions for respectively 
displaying different types of frames around multiple items of information, the different 
types of frames being associated with different metadata (section 23). Therefore, the 
limitations of claim 44 are rejected in the analysis of claim 43 above, and the claim is 
rejected on that basis. 

With respect to claim 45, Rothmuller teaches instructions for selecting one or 
more tags of the different types of tags from a list of tag types (i.e., items 300, 31 0, 320, 
and 350 in fig. 1 and section 5). Therefore, the limitations of claim 45 are rejected in the 
analysis of claim 44 above, and the claim is rejected on that basis. 

With respect to claim 46, Rothmuller teaches instructions for displaying the list of 
tag types (i.e., items 300, 310, 320, and 350 in fig. 1 and section 5). Samra further 
teaches an information identifier option key is associated with a selected item of 
information (i.e., indicating the object to be annotated by selecting, sections 39-40). 
Therefore, the limitations of claim 46 are rejected in the analysis of claim 45 above, and 
the claim is rejected on that basis. 
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With respect to claim 47, Samra further teaches instructions for displaying a pop- 
up window for entering a text note to be associated with the selected item of information 
when the information identifier option key is associated with the selected item of 
information (i.e., a dialogue box is appeared to allow the user to type a text message to 
be associated with a selected object, sections 40 and 13-14). Therefore, the limitations 
of claim 47 are rejected in the analysis of claim 46 above, and the claim is rejected on 
that basis. 

With respect to claim 50, Samra teaches instructions for displaying the framed 
items of information near the top of the media view (i.e., display priority, section 53) in 
order to provide convenient, easily identified, information to a user without unduly 
cluttering the display (section 31). Therefore, the limitations of claim 50 are rejected in 
the analysis of claim 1 1 above, and the claim is rejected on that basis. 

With respect to claim 52, Samra teaches a visual annotation marker of an object 
being associated with the text note (i.e., when a text message is completed, the 
annotated object is marked visually with an annotation marker, sections 40, 35-36, and 
44 and figs. 1C-1 D). Therefore, the limitations of claim 52 are rejected in the analysis of 
claim 21 above, and the claim is rejected on that basis. 

With respect to claim 53, Lauris further teaches respectively displaying different 
types of frames around multiple items of information, the different types of frames being 
associated with different metadata (section 23). Therefore, the limitations of claim 53 
are rejected in the analysis of claim 52 above, and the claim is rejected on that basis. 
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With respect to claim 54, Rothmuller teaches selecting one or more tags of the 
different types of tags from a list of tag types (i.e., items 300, 310, 320, and 350 in fig. 1 
and section 5). Therefore, the limitations of claim 54 are rejected in the analysis of 
claim 53 above, and the claim is rejected on that basis. 

With respect to claim 55, Rothmuller teaches displaying the list of tag types (i.e., 
items 300, 310, 320, and 350 in fig. 1 and section 5). Samra further teaches an 
information identifier option key is associated with a selected item of information (i.e., 
indicating the object to be annotated by selecting, sections 39-40). Therefore, the 
limitations of claim 55 are rejected in the analysis of claim 54 above, and the claim is 
rejected on that basis. 

With respect to claim 56, Samra further teaches displaying a pop-up window for 
entering a text note to be associated with the selected item of information when the 
information identifier option key is associated with the selected item of information (i.e., 
a dialogue box is appeared to allow the user to type a text message to be associated 
with a selected object, sections 40 and 13-14). Therefore, the limitations of claim 56 are 
rejected in the analysis of claim 55 above, and the claim is rejected on that basis. 

With respect to claim 59, Samra teaches displaying the framed items of 
information near the top of the media view (i.e., display priority, section 53) in order to 
provide convenient, easily identified, information to a user without unduly cluttering the 
display (section 31). Therefore, the limitations of claim 59 are rejected in the analysis of 
claim 21 above, and the claim is rejected on that basis. 
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With respect to claim 61 , Rothmuller teaches a display in communication with the 
processing unit that presents a combined view of the media view and the media file 
identifier (fig. 1 and fig. 2). 

6. Claims 30, 32, 34-38, and 41 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rothmuller et al. (U.S. Publication No. 2003/0033296) in view of 
Lauris (U.S. Publication No. 2003/0095143), and further in view of Samra et al. (U.S. 
Publication No. 2002/0113803). 

With respect to claim 30, Rothmuller discloses the claimed subject matter as 
discussed above except instructions for altering a size, color, or border of the 
information identifier associated with the at least one item of information. However, 
Lauris teaches instructions for altering a size, color, or border of the information 
identifier associated with the at least one item of information (i.e., altering a color, 
sections 23 and 12) in order to provide a look and feel of a graphical status display 
(sections 8 and 12). Therefore, based on Rothmuller in view of Lauris, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
to utilize the teaching of Lauris to the system of Rothmuller in order to provide a look 
and feel of a graphical status display. Samra also teaches instruction for graphically 
altering a representation of the respective item of information in a manner visually 
distinct from the associated text note (i.e., when a text message is completed, the 
annotated object is marked visually with an annotation marker, sections 40, 35, and 44 
and figs. 1C-1D) in order to provide convenient, easily identified, information to a user 
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without unduly cluttering the display (section 31). Samra teaches the altering includes 
at least one of altering the size, color, or border of the representation of the selected 
item of information (i.e., a visual annotation in different colors, shapes, and animations, 
sections 31 , 35-37, and 39-44 and fig. 1 ). Therefore, based on Rothmuller in view of 
Lauris, and further in view of Samra, it would have been obvious to one having ordinary 
skill in the art at the time the invention was made to utilize the teaching of Samra to the 
system of Rothmuller in order to provide convenient, easily identified, information to a 
user without unduly cluttering the display. 

With respect to claim 32, Rothmuller teaches displaying a window, after the 
information identifier is associated with the respective item of information, in order to 
allow a user to input the text note to be associated with the respective item of 
information (i.e., providing a window to a user after a metadata tag icon is associated 
with a media object and allowing a user to edit metadata and/or photo notes, section 24 
and fig. 2). 

With respect to claim 34, Rothmuller teaches instructions for providing for a text 
note to be associated with a respective item of information and to be included in 
metadata associated with the respective item of information (i.e., entering textual 
information as metadata of an object, sections 5-6 and 18-19 and figs. 1-2). Lauris 
teaches a frame around the at least one item of information (i.e., a colored border 
around an object for a visual indicator, sections 8, 12, and 23) in order to provide a look 
and feel of a graphical status display (sections 8 and 1 2). Rothmuller and Lauris do not 
explicitly disclose frame around the at least one item of information being associated 
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with the text note. However, Samra teaches a visual annotation marker of an object 
being associated with the text note (i.e., when a text message is completed, the 
annotated object is marked visually with an annotation marker, sections 40, 35-36, and 
44 and figs. 1C-1 D) in order to provide convenient, easily identified, information to a 
user without unduly cluttering the display (section 31). Therefore, based on Rothmuller 
in view of Lauris, and further in view of Samra, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to utilize the teaching 
of Samra to the system of Rothmuller in order to provide convenient, easily identified, 
information to a user without unduly cluttering the display. 

With respect to claim 35, Lauris teaches instructions for respectively displaying 
different types of frames around multiple items of information, the different types of 
frames being associated with different metadata (section 23). Therefore, the limitations 
of claim 35 are rejected in the analysis of claim 34 above, and the claim is rejected on 
that basis. 

With respect to claim 36, Rothmuller teaches instructions for selecting one or 
more tags of the different types of tags from a list of tag types (i.e., items 300, 31 0, 320, 
and 350 in fig. 1 and section 5). Therefore, the limitations of claim 36 are rejected in the 
analysis of claim 35 above, and the claim is rejected on that basis. 

With respect to claim 37, Rothmuller teaches instructions for displaying the list of 
tag types (i.e., items 300, 310, 320, and 350 in fig. 1 and section 5). Samra further 
teaches an information identifier option key is associated with a selected item of 
information (i.e., indicating the object to be annotated by selecting, sections 39-40). 
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Therefore, the limitations of claim 37 are rejected in the analysis of claim 36 above, and 
the claim is rejected on that basis. 

With respect to claim 38, Samra further teaches instructions for displaying a pop- 
up window for entering a text note to be associated with the selected item of information 
when the information identifier option key is associated with the selected item of 
information (i.e., a dialogue box is appeared to allow the user to type a text message to 
be associated with a selected object, sections 40 and 13-14). Therefore, the limitations 
of claim 38 are rejected in the analysis of claim 37 above, and the claim is rejected on 
that basis. 

With respect to claim 41 , Rothmuller and Lauris disclose the claimed subject 
matter as discussed above except instructions for displaying the framed items of 
information near the top of the media view. However, Samra teaches instructions for 
displaying the framed items of information near the top of the media view (i.e., display 
priority, section 53) in order to provide convenient, easily identified, information to a user 
without unduly cluttering the display (section 31). Therefore, based on Rothmuller in 
view of Lauris, and further in view of Samra, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to utilize the teaching of 
Samra to the system of Rothmuller in order to provide convenient, easily identified, 
information to a user without unduly cluttering the display. 

7. Claims 39-40 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Rothmuller et al. (U.S. Publication No. 2003/0033296) in view of Lauris (U.S. 
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Publication No. 2003/0095143) and Samra et al. (U.S. Publication No. 2002/01 13803), 
and further in view of Smith et al. (U.S. Publication No. 2002/0147744). 

With respect to claim 39, Rothmuller, Lauris, and Samra disclose the claimed 
subject matter as discussed above. Samra teaches a pop-up window for an inputting 
and outputting interface (sections 36 and 40). Rothmuller, Lauris, and Samra do not 
explicitly disclose instructions for adding the text note entered into the pop-up window to 
a selectable list of text notes. However, Smith teaches instructions for adding the text 
note entered into a window to a selectable list of text notes (sections 35 and fig. 5) in 
order to allow the user to recall previous text entries (section 23). Therefore, based on 
Rothmuller in view of Lauris and Samra, and further in view of Smith, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
to utilize the teaching of Smith to the system of Rothmuller in order to allow the user to 
recall previous text entries. 

With respect to claim 40, Rothmuller teaches instructions for searching the items 
of information by frame type and/or text note (i.e., searched by textual information, 
section 6). Therefore, the limitations of claim 40 are rejected in the analysis of claim 39 
above, and the claim is rejected on that basis. 

8. Claims 48-49 and 57-58 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Rothmuller et al. (U.S. Publication No. 2003/0033296) in view of 
Samra et al. (U.S. Publication No. 2002/0113803) and Lauris (U.S. Publication No. 
2003/0095143), and further in view of Smith et al. (U.S. Publication No. 2002/0147744). 
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With respect to claim 48, Rothmuller, Samra, and Lauris disclose the claimed 
subject matter as discussed above. Samra teaches a pop-up window for an inputting 
and outputting interface (sections 36 and 40). Rothmuller, Samra, and Lauris do not 
explicitly disclose instructions for adding the text note entered into the pop-up window to 
a selectable list of text notes. However, Smith teaches instructions for adding the text 
note entered into a window to a selectable list of text notes (sections 35 and fig. 5) in 
order to allow the user to recall previous text entries (section 23). Therefore, based on 
Rothmuller in view of Samra and Lauris, and further in view of Smith, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
to utilize the teaching of Smith to the system of Rothmuller in order to allow the user to 
recall previous text entries. 

With respect to claim 49, Rothmuller teaches instructions for searching the items 
of information by frame type and/or text note (i.e., searched by textual information, 
section 6). Therefore, the limitations of claim 49 are rejected in the analysis of claim 48 
above, and the claim is rejected on that basis. 

With respect to claim 57, Rothmuller, Samra, and Lauris disclose the claimed 
subject matter as discussed above. Samra teaches a pop-up window for an inputting 
and outputting interface (sections 36 and 40). Rothmuller, Samra, and Lauris do not 
explicitly disclose adding the text note entered into the pop-up window to a selectable 
list of text notes. However, Smith teaches adding the text note entered into a window to 
a selectable list of text notes (sections 35 and fig. 5) in order to allow the user to recall 
previous text entries (section 23). Therefore, based on Rothmuller in view of Samra 
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and Lauris, and further in view of Smith, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to utilize the teaching of 
Smith to the system of Rothmuller in order to allow the user to recall previous text 
entries. 

With respect to claim 58, Rothmuller teaches searching the items of information 
by frame type and/or text note (i.e., searched by textual information, section 6). 
Therefore, the limitations of claim 58 are rejected in the analysis of claim 57 above, and 
the claim is rejected on that basis. 



Conclusion 

9. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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1 0. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JOON H. HWANG whose telephone number is 
(571)272-4036. The examiner can normally be reached on 9:30-6:00(M~F). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Hosain T. Alam can be reached on 571-272-3978. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Patent Examiner 
Technology Center 2100 
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